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Quantitative  aids  to  decision-making  have  existed  for 
many  years.  Their  complex  nature,  however,  prevents  many 
mid-level  and  lower-level  managers  from  using  these  aids 
in  their  routine  activities.  This  research  represents 
an  attempt  to  develop  a  technique  that  will  make  these 
aids  more  accessible  to  those  managers  who  do  not  employ 
a  research  staff. 
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ABSTRACT 


Quantitative  models  for  dec ision-mak ing  are  useful 
only  if  they  uri  available  to  those  who  must  make  the  de¬ 
cisions.  QUL'UL'l  i  an  interactive  computer  program  which 
incorporates  six  basic  queueing  theory  models,  wu3  develop¬ 
ed.  QUEUL'l  and  Pb*»  aown.pi  r  ,y  i  ’4;  instructions  were  design¬ 
ed  for  use  by  mid-level  managers  who  do  not  have  an 
extensive  knowledge  of  computer  operations  or  modeling 
theory.  QUEUE1  was  tested  on  five  individuals.  Test 
results  lead  to  the  conclusion  that  interactive  program¬ 
ming  techniques  can  present  quantitative  models  to  non¬ 
technical  managers  in  a  useable  format. 
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INTERACT  1 VI-  PROGRAMING  ICR  MANAGEMENT 


AIDS  TO  DECISION-MAKING « 

QUEUEING  THEORY  APPLIED 

1 .  INTRODUCTION 

”...  the  cor.putci',  for  those  who  under¬ 
stand  anything  about  it,  is  emancipation 
for  the  individual.  The  purpose  of  the 
computer  is  to  enable  us  not  to  spend 
time  on  'controls'  but  to  use  the  time 
for  tasks  that  require  perception,  imag¬ 
ination,  human  relations,  and  creativity...” 

Peter  F.  Druckor  (Ref  10i2$9) 

A  review  of  the  literature  concerning  management  reveals 
that  the  computer  has  entered  the  manager's  domain  and  is 
there  to  stay.  Indeed,  the  comment  at  the  beginning  of  this 
chapter  is  echoed  in  one  form  or  another  in  virtually  every 
management  journal  and  textbook  published  in  the  last  decade. 
Still,  when  one  examines  the  management  theories  and  tech¬ 
niques  in  this  same  literature,  the  computer  does  not  appear 
as  a  primary  component  of  current  management  models.  Rather, 
the  computer  is  relegated  to  the  ancillary  role  of  an  aid  to 
the  management  of  information.  What  is  important  is  the 
growing  concern  by  the  management  community  over  the  effec¬ 
tive  integration  between  manager  and  computer.  That  is  not 
to  say  that  current  management  theory  understates  the  power 
of  modern  technology.  The  concern  is,  in  part,  a  realization 
that  the  complex  technology  continually  outdistances  the 
manager's  ability  to  utilize  the  full  potential  of  the 
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computer  as  an  aid  to  decision-making'.  It  can  bo  demon¬ 
strated  that  this  concern  is  well  founded.  First,  however, 
the  manager's  viewpoint  should  be  considered. 

An  informed  manager  realizes  that  even  routine  decisions 
cannot  be  formulated  solely  on  the  basis  of  "g’.t  feelings,** 
intuition,  and  prior  practices.  Elfective  decisions  are  the 
result  of  structured  analysis  of  pertinent  information. 
Analysis  techniques  should  be  consistent  with  the  problem 
being  considered.  "The  lield  of  operations  research,  or 
management  science,  is  cor. earned  with  the  development  and 
application  of  quantitative  techniques  to  the  solution  of 
problems  faced  by  managers  of  public  ar:d  private  organiza¬ 
tions"  (Ref  Ct?.).  Modern  management  theory  recognizes  the 
need  for  quantitative  decision-making  in  routine  management 
efforts  (Ref  2ki  1**5)  •  A  representative  paradigm  for  quan¬ 
titative  decision-making  is  reproduced  in  Table  1. 

The  accomj  iishment  of  Problem  Konr.ulat ion ,  Kcdcl  Con¬ 
struction,  Data  Collection,  and  Model  Solution  are  of  concern 
here.  A  manager  considering  even  routine  problems  might  re¬ 
quire  the  aid  of  a  mathematician,  a  statistician,  a  research 
analyst  and  a  computer  programmer  to  effectively  complete 
these  steps.  It  is  a  fortunate  manager  who  has  ready  access 
to  such  valuable  human  resources. 

Clearly,  many  routine  problem  situations  do  not  warrant 
the  expense  of  providing  these  resources.  The  major  intent 
of  this  thesis  is  to  demonstrate  that  quantitative  models 


TABLE  1 


A  Decision-Making  Puradiftn 

I.  Recognition  of  a  Need.  (The  perception 
that  some  action  need:;  to  be  taken,  or 
per  hup::  taken  better.) 

II.  Problem  Formulation.  (Translation  of 
the  perceived  need  into  an  explicit 
statement  ol  both  the  need  and  the 
criteria  by  which  the  problem  solution 
is  to  be  judged. ) 

III.  Me do l  Construct  ion.  (Construction  of  a 
mathama t i sal  rtiJiru  or  representation 
of  the  problem.) 

IV.  Data  Collection.  (The  specific  inputs 
to  the  model  which  reflect  actual  prob¬ 
lem  conditions.) 

V.  Model  Solution.  (Manipulation  ol  the 
input  data  to  produce  results.) 

VI.  Model  Validation  and  Sensitivity  Analysis. 
(Testing  model  results  to  ensure  validity 
and  the  implications  of  errors  in  esti¬ 
mating  input  data.) 

VII.  Interprcta • ion  of  Results  and  Implications. 
(Broad  reexamination  of  problem  criteria 
in  light  of  model  results.) 

VIII.  Decision  Making,  Implementation,  and 

Control.  (Behavioral  and  technical  change 
requirements  in  both  short-run  and  long- 
run  conditions.) 


(Ref  60) 
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for  dec ision-mak ing  can  be  made  available  to  managers 
through  interactive  computer  programming  in  a  form  that  doer, 
not  require  technical  proficiency  in  the  fields  of  Operations 
Research  and  Computer  Science. 

Background 

A  quantitative  model  is  a  representation  of  a  "real- 
world"  system  which  is  designed  to  describe  the  relationship 
between  specified  inputs  and  outputs.  It  can  be  viewed  as 
an  open  system  as  shown  in  Figure  1.  The  input  represents 
known  variables  which  define  the  parameters  and  conditions 
upon  which  the  model  operates  to  produce  desired  inloi-mation 
about  the  system  being  represented.  This  desired  information 
is  the  output.  Managers  who  lack  extensive  background  in 
the  principles  of  mathematics  underlying  the  model  may  not 
be  able  to  apply  the  model  to  practical  situations.  Inputs 
entered  in  error  result  in  outputs  that  are  misleading  and 
confusing. 

Since  World  War  II,  analysts  in  the  lield  of  Operations 
Research  have  develop'd  a  great  number  of  quantitative  models 
for  application  in  government  and  industry.  Table  II  is  a 
list  of  some  of  the  types  that  are  available  today. 

The  models  listed  in  Table  II  often  rely  heavily  on  the 
use  of  computers  to  perform  lengthy  and  complicated  calcu¬ 
lations.  In  general,  managers  do  not  possess  the  ability  to 
perform  the  required  mathematical  manipulations  manually. 
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Figure  1.  Model  Function 


TABLE  II 


Types  of  Operations  Research  Problems 


A 1  location 

Assembly  Line  Balancing 
Assignment 

Payesian  Decision  Models 
pi*'.  M  Method 

binary  Linear  Programming 
branch  and  Found  Method 
budget  Problems 
Classical  0{  tini ration 
Competitive  Model 
Convex  Programming 

ay 

Cut  tin  g  Plane  Method 
Dec  i  r  ion  Theory  /Ana  1  y  r,  i  a 
Deterministic  Models 
Discrete  Programming 
Dynamic  Programs.  i ng 
Fixed  Charge  Problems 

~  Theory 
'  metric  Programming 
1 1  Programming 
• h  Theory 

•  r  istics 

/"■rid  (deterministic  and 
stochastic ) 
'licit  Enumeration 

•  ■'gor  Programming 

'  "  ntory 

{•sack  Problems 

•i  »ngo  Mul  tipi  iers 

'  ir  Optimization 

•  «r  Programming 
'  '■'•v  Chains 


Matching  Problems 
Mixed/integer  Programming 
Ne  t works 

Nonl inear  Opt imiza t i on 
Nonl inear  Programming 
Parametric  Linear  Programming 
PLhT 

Plant  Location  Models 

Portfolio  Models 

Quadratic  Programming 

Queueing 

Random  Numbers 

Kogi  ess  ion  Analysis 

Kel iabi 1 i ty 

Replacement  Models 

RoutiJig 

Schodul ing 

Search  (for  information  or 
decision) 

Search  Methods  (nonlinear) 
Sensitivity  Analysis 
Separabl  e  Progr.'imm  i  r.g 
Sequenc  irig 
Set  Covering 
Simula t ion 

Stochastic  Processes 
Stochastic  Programming 
Tranrpor  tation 
Transshipment 
Traveling  Salesmen 
Utility  Models/Theory 
Zero -One  Programming 

(Ref  23«67) 
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Nor  can  they  afford  the  time.  Likewise,  managers  do  not 
have  the  ability  or  time  to  program  computers  to  perform 
the  work  for  them.  From  their  perspective,  the  use  of 
computers  and  quantitative  models  is  an  aid  to  achieving 
other  objectives,  not  an  objective  in  itself.  In  short,  a 
manager's  expertise  is  in  management,  not  in  Computer  Science. 
However,  the  need  for  managers  to  be  familiar  with  computers 
is  well  established. 

An  empirical  study  conducted  at  the  University  of 
Nebraska  emphasizes  this  need  (Ref  20).  This  investigation 
of  the  impact  of  computer  generated  information  on  the  choice 
activity  of  decision-makers  suggests  that  a  bias  in  inter¬ 
pretation  exists  in  the  following  form.  Individuals  having 
little  or  no  experience  with  computers  demonstrate  more 
confidence  in  information  when  it  is  presented  in  the  form 
of  a  computer  product  than  when  it  is  not.  Alternatively, 
individuals  having  a  greater  degree  of  experience  with 
computers  and  computer  products  demonstrate  lens  confidence 
in  information  presented  in  the  form  of  a  computer  product. 
This  would  indicate  that  Management  students  would  benefit 
from  a  curriculim  that  increases  their  confidence  in  judging 
the  reliability  of  such  information. 

Statement  of  the  Problem 

The  power  of  quantitative  models  for  decision-making 
benefit  the  decision-maker  only  to  the  extent  that  he  can 


7 


put  them  to  use  on  matters  at  hand.  The  problem  is  stated 
in  three  parts. 

First,  quantitative  models  are  based  on  theorems  of 
mathematics  (Kef  6x2).  Managers  are  not  always  able  to 
master  and  sustain  a  working  proficiency  in  those  subjects. 

Aj plication  of  these  theorems,  then,  must  be  incorporated 
in  the  models  available  to  the  manager  in  one  of  the  follow¬ 
ing  ways. 

a.  The  theorems  are  integrated  within  the  model 
and  applied  without  the  need  for  direct  inter¬ 
action  by  the  user. 

b.  The  knowledge  required  for  accurate  input  is 
condensed  to  a  form  consistent  with  the  user's 
capability  to  comprehend  and  apply. 

Second,  the  models  often  rely  on  computers  to  perform 
complicated  und  1  eng thy  calculations.  Managers  must  be  able 
to  access  a  computer  without  extensive  education  in  Computer 
Science. 

Third,  managers  must  be  confident  that  the  information 
generated  by  quantitative  models  arc  useful  in  the  decision¬ 
making  process.  This  point  deserves  added  attention  where 
the  information  is  in  the  form  of  computer  products.  Compute 
generated  information  should  bo  pertinent  and  easily  inter¬ 
preted. 

Objee  t ives 

The  goal  of  this  thesis  is  to  demonstrate  that  properly 
designed  computer  programs  can  give  managers  access  to  compli 


catcd  quantitative  models  for  decision-making.  To  this  end, 
the  following  objectives  support  this  goal. 

1.  Create  a  computer  program  for  a  representative 
set  of  quantitative  models  currently  studied 
by  graduate  students  in  the  Systems  Management 
program  at  the  Air  Force  Institute  of 

Techno 1 o gy  ( AFI T) . 

2.  Develop  appropriate  instructional  material  and 
execution  aids  for  the  computer  program. 

3-  Demonstrate  that  quantitative  models  for 

decision-making  can  be  applied  by  individuals 
who  are  unfamiliar  with  computer  operations 
and  th<  theory  underlying  these  models  using 
interactive  programming  techniques. 

The  result::  of  this  thesis  eflort  will  be  presented  in 
the  following  order* 

1.  The  method  used  in  developing  and  testing 
the  interactive  program  and  its  accompanying 
ins true  tions. 

2.  A  description  of  the  computer  program  to  in¬ 
clude  a  diagram  of  its  logic,  a  program 
listing,  and  a  discussion  of  its  important 
features. 

3.  Results  of  the  testing  phase  to  include  sta¬ 
tistics  and  comments  from  the  test  subjects. 

4.  A  nummary  and  conclusions  with  recommendations 
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11.  KKTiiODOLOCY 


The  Models 

As  stated  in  the  introductory  chapter,  this  thesis 
deals  with  developing  a  computer  program  to  perform  the 
calculations  for  quantitative  analytical  models.  Queueing 
theory  provides  an  excollant  source  for  candidate  models. 
Those  selected  for  this  effort  are  classic  queueing  theory 
models  which  describe  service  systems  characterized  by 
exponential  interarrival  and  service  time  distributions. 

Under  the  classification  system  of  D.  G.  Kendall,  these 
models  are  of  the  M/M/C  type  (Ref  6t438).  Under  this  clas- 
sification  system,  the  first  M  signifies  that  the  model 
assumes  an  exponential  distribution  for  the  time  between 
customer  arrivals  (equivalent  to  a  Poisson  distribution  for 
customer  arrival  frequency).  The  second  M  signifies  that 
the  model  assumes  an  exponential  distribution  for  customer 
service  times.  The  C,  when  specified,  indicates  the  number 
of  parallel  servers  in  the  system.  Six  such  modeling  situa¬ 
tions  are  captured  in  the  computer  program.  The  particular 
situations  deal  with  different  combinations  of  server  number, 
allowable  queue  size,  and  customer  population  size.  The 
individual  models  and  their  characteristics  are  listed  belowj 
1.  Standard  M/M/l  Model!  describes  the  steady-state 
operating  characteristics  of  a  service  system  with 
one  server.  No  limits  are  placed  on  the  size  of 
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the  queue  or  the  customer  population. 

2.  Finite  Queue  M/M/ 1  Models  describee  the  steady- 
state  operating  characteristics  of  the  Standard 
M/M/1  Model  in  which  the  queue  is  restricted  to  a 
finite  length. 

3.  Finite  I’opulation  M/k/1  Model;  describes  the  steady- 
state  operating  characteristics  of  the  Standard 
V./b'/l  Model  in  which  the  calling  population  is 

of  n  finite  size. 

4.  Standard  V/V./C  Model;  describes  the  steady-state 
operating  characteristics  of  a  service  system  with 
two  or  more  identical  servers.  No  limits  arc 
placed  on  the  size  of  the  queue  or  the  customer 
population. 

3.  Finite  Queue  M/V./C  Model;  describes  the  steady- 
state  operating  characteristics  of  the  Standard 
M/M/C  Model  in  which  the  queue  is  limited  to  a 
finite  length. 

6.  Finite  Population  M/M/C  Model;  describes  the  steady- 
state  operating  characteristics  of  the  Standard 
M/M /C  Model  in  which  the  calling  population  is  of 
a  finite  size. 

Two  logical  extensions  to  those  models  exist.  The  first 
of  these  applies  to  single  server  systems  in  which  the  time 
needed  to  service  a  customer  can  be  controlled  or  adjusted. 
Given  that  there  is  a  cost  associated  with  having  customer 
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unit:;  wait  in  the  queue  in  anticipation  of  service  as  well 
as  a  marginal  cost  associated  with  providing  that  service; 
it  can  be  demonstrated  that  there  exists  a  particular  rate 
of  service  which  yields  the  lowest  overall  cost  per  unit 
time  lor  operating  the  system.  This  rate,  the  optimal 
service  rate,  is  a  function  of  the  customer  arrival  rate, 
the  cost  of  having  customer  units  wait  and  the  marginal 
cost  of  servicing  each  customer  unit.  This  marginal  cost 
of  service  is  the  same  as  the  variable  cost  of  providing 
service  to  each  unit  ns  dis tinquished  from  the  fixed  cost 
of  making  the  service  available. 

The  second  extension  applies  to  multiple  server 
systems  in  which  there  exists  an  option  to  vary  the  number 
of  servers  provided.  Again,  the  object  is  to  minimize  the 
overall  cost  of  operating  the  service  system;  this  time  by 
selecting  the  optimal  number  of  servers  bared  on  the  cost 
of  having  units  waiting  in  the  queue,  the  expected  number 
of  units  in  the  system  and  the  cost  of  providing  the 
individual  servers. 

A  complete  discussion  of  these  models  and  the  classi¬ 
fication  system  can  be  found  in  most  undergraduate  and 
graduate  level  texts  on  Operations  Research  or  Queueing 
Theory.  The  program  developed  in  this  thesis  uses  the 
equations  presented  by  Budnick,  Mojena,  and  Vollman  in 
their  text,  ?r  incipal  s  of  Opera  lions  Rf  searrh  for  Pan  a  fo¬ 
ment  (Ref  6i429-^?M. 
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Pregt ‘arntnir.,  Ob.u  c  t  :  yes 

The  procram  itself  is  designed  lor  use  at  a  time  char¬ 
ing  terminal.  This  allows  the  program  to  assist  the  user 
with  inputting  the  necessary  data  for  model  selection  and 
program  execution.  The  intent  is  to  lead  the  user  through 
a  sequence  of  questions  and  commands  which  will  result  in 
an  immediate  solution  to  the  desired  model  parameters.  The 
inputs  required  lor  program  execution  are  number  of  servers 
allowable  queue  length,  population  size,  customer  arrival 
rate,  and  service  rate.  The  objective,  that  the  program 
be  easy  to  use,  requires  that  the  input  format  not  be  over¬ 
ly  re i  trictive.  That  is  to  say,  a  background  in  computer 
language  should  not  be  a  prerequisite  for  use.  Similarly, 
the  ro'sulting  output  must  bo  easily  understood. 

Opera  t  i  Instructions  and  t-.  id:; 

Detailed  operating  i'  structions  for  the  program  are 
included  in  Appendix  C  of  this  thesis.  Thoy  includet 

1.  Step  by  step  instructions  for  accessing  the 
compu*  r  facilities  at  the  AFIT  School  of 
Engineering,  using  the  tine  sharing  remote 
terminals. 

2.  A  brief  description  of  the  program  and  the  types 
of  problems  it  solves. 


3*  An  explanation  of  tho  inputs  required  for  program 
exceut ion. 


4.  An  explanation  of  the  outputs  generated  by  the 
program. 

j>.  Kxamples  of  all  phases  of  program  operation. 

Testing  of  Ob.iec  *.  i  vc:; 

The  program  and  its  accompanying  instructions  were 
tested  to  ascertain  the  extent  to  which  they  meet  stated 
objectives.  Five  subject;;  of  varying  education  levels 
and  computer  experience  were  asked  to  use*  the  program  to 
solve  representative  queueing  theory  problems.  The  program 
and  instructions  are  evaluated  on  the  basis  of  the  ability 
of  each  subject  to  operate  a  remote  terminal ,  input  infor¬ 
mation  correctly,  and  inter; ret  the  outputs  as  well  as  the 
confidence  they  place  in  the  resulting  information.  The 
subjects  were  placed  in  a  room  with  a  remote  terminal  and 
asked  to  complete  tv<o  situational  problems  involving 
service  systems.  These  pro bless  ere  listed  in  Appendix  c. 
The  only  aids  allowed  wore  the  written  instructions  for 
the  program  contain'd  in  Appendix  C.  After  the  test 
session,  the  subjects  provided  information  by  completing 
the  questionaire  shown  in  Appendix  D.  The  results  of  this 
test  are  reported  in  Chapter  IV.  A  detailed  explanation 
of  the  program  is  provided  in  the  next  chapter. 
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111.  PROGRAM  Di'L'C'iirriON 


Program  K1  oments: 

The  specific  pro  {yam  developed  for  this  thesis  effoi't 
is  written  in  FORTRAN  IV.  It  is  divided  into  nine  elemi nt 
as  follow::: 

1.  The  primary  program,  MAIN,  directs  all  user 
interactions  to  includes  model  selection,  problem 
inputs  and  solution  printouts. 

2.  A  subroutine,  WRONG,  which  aids  the  user  in 
correcting  erroneous  responses  to  "yes"  or  "no" 
questions. 

3.  A  function,  FACT,  which  computes  factorials  used 
by  other  procram  elements. 

4.  A  subroutine,  DATA1 ,  which  compares  observations 
of  customer  arrivals  with  the  distribution  assump¬ 
tions  of  the  models. 

5.  A  subroutine,  DATA 2 ,  which  compares  observations 
of  service  tima-s  with  the  distribution  assumptions 
of  the  models. 

6.  A  subroutine,  PROPS,  called  by  DATA1  to  compute 
Poisson  probabilities. 

7.  A  subroutine,  PROBE,  called  by  DATA2  to  compute 
exponential  probat ilitier. 

8.  Six  subroutines  corresponding  to  the  six  discrete 
models  referred  to  in  Chapter  II « 


mode:. 

SURROU  I' INK 

Standard  M/M/l 

STMM1 

Finite  Queue  M/M/ 1 

FQMM1 

Finite  population  M/M/l 

FI  MM  1 

Standard  M/M/C 

STMMC 

Finite  Queue  M/M/C 

FQKMC 

Finite  Population  M/M/C 

Ff’MMC 

y.  A  subroutine,  OPTMU,  which  computes  the  optimal 
service  rate  lor  all  service  systems  restricted 
to  one  server  (M/M/l  type  model  r). 

10.  A  subroutine,  OPTC,  which  computes  the  optimal 
number  of  servers  for  multiple  server  systems 
(m/m/C  type  model;;). 

All  numerical  inputs  to  the  program  are  free  of  format 
restrictions.  That  in  to  nay,  decimal  fractions  may  be 
entered  in  star -lard  fc-rr.  and  the  use  of  decimal  points 
with  whole  numbers  in  oj  tional.  Du>  to  the  nature  of  the 
modeling  theory,  n  ,  »*ivt  values  are  meaningless  as  inputs 
and  are  never  entered. 

The  following  sections  describe  the  logic  flow  used  in 
the  program.  Relercr.ce  to  Appendix  A,  Definitions  of 
Variables,  will  aid  in  comprehending  these  discussions. 
Figure  Z  presents  a  simplified  logic  diagram  of  MAIN.  A 
more  detailed  logic  for  all  elements  is  depicted  in  the 
flow  diagrams  in  Appendix  a.  Examples  of  executed  programs 
are  contained  in  Appendix  C. 
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2.  Simplified  Program  Ixigic 


Program  MA 1 N 

The  baiiic  operations  of  MAIN  are i 

1.  Select  the  appropriate  model. 

2.  Receive  inputs  describing  the  specific  service 
system. 

Direct  the  appropriate  subroutine  to  compute 
steady-state  characteristics  for  the  service 
system. 

4.  Echo  the  input  data  for  verification  and  print  the 
steady -s fate  characteristic:. 

At  the  option  of  the  user,  call  a  subroutine  to 
optimize  service  rate  or  server  number  a:  appro¬ 
priate  . 

6.  At  the  option  of  the  user,  run  additional  problem 
sequences  or  terminate  the  program. 

At  the  program  beginning,  the  six  models  art  listed 
for  the  user  along  with  the  identifying  code  numbers.  At 
this  point,  the  user  is  given  the  option  of  selecting  a 
desired  model  by  transmitting  its  corresponding  code. 
Alternatively,  if  the  user  is  not  certain  which  model  best 
fits  his  particular  service  {system,  a  sequence  of  program 
inquiry  will  select  the  model  for  him.  The  first  input 
for  this  sequence  is  server  number  (C).  An  input  of  one 
server  results  in  the  program  variable  MSIGN  taking  a 
value  of  0.  An  input  of  two  or  more  servers  results  in 
MSIGN  taking  the  value  of  3*  Effectively,  this  divides  the 
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models  into  two  group:;,  the  M/V./l  type  und  the  K./b'./C  type, 
respectively.  The  user  is  then  asked  it  the  queue  is 
limited  to  a  finite  number.  If  so,  a  program  variable  MVAL 
is  given  the  value  2.  If  the  queue  is  not  limited,  then 
possibly  the  "customer"  population  is  limited  to  a  finite 
number.  If  this  is  the  case,  MVAL  is  given  the  value 
11  neither  the  queue  nor  the  customer  population  is  limited, 
MVAL  equals  1  by  default.  MS1GN'  and  MVAL  arc  then  added 
together  and  the  sura  corresponds  to  the  correct  code  for 
the  best  model.  From  this  point  on  MVA1  identifies  the 
chosen  modeling  situation. 

Computation  of  steady-state  characteristics  by  the  six 
subroutines  requires  the  input  of  the  following  parameters : 
PA  RAF!.  "HR  VARIABLE  NAME 

1.  Server  number  C 

2.  Maximum  queue  length  LIMQ 

(finite  queue  models) 

3.  Customer  population  size  M 

(finite  population  models) 

4.  Customer  arrival  rate  LAMBDA 

5.  Service  rate  MU 

C,  LIMQ,  and  M  arc  entered  during  model  selection. 

LAMBDA  arid  MU  may  be  entered  directly  into  the  program, 
or  sample  data  concerning  arrivals  and  service  timeG  may 
be  entered  instead.  When  s;unple  data  is  entered,  it  is 
checked  to  see  if  the  arrivals  and  service  times  arc 
distributed  in  accordance  with  the  model  assumptions  and 
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LAMBDA  and  MU  are  computed  from  that  data.  These  checks 
and  computations  are  performed  by  the  subroutines  DATA1 
and  DATA 2  which  are  discussed  later.  It  should  be  noted 
that,  in  case  of  the  finite  population  models,  the  input 
LAMBDA  refers  to  the  mean  arrival  rate  of  each  individual 
population  member.  In  the  remaining  models,  LAMBDA 
measures  the  mean  arrival  rate  of  all  customers  to  the 
service  system. 

Once  the  inputs  arc  transmitted,  the  program  calls  the 
appropriate  model  subroutine  to  compute  the  steady-state 
characteristics  which  are  then  returned  to  MAIN  to  be  in¬ 
cluded  in  the  output  listing.  The  logic  flow  for  these 
subroutines  is  discussed  later  in  this  chapter. 

The  output  listing  begins  with  an  echo  of  the  input 
parameters.  This  allows  the  user  to  verify  that  the  system 
is  being  described  as  intended  and  also  provides  a  complete 
model  description  separated  from  the  record  of  user/program 
interaction.  The  steady-state  characteristics  included  in 
the  listing  vary  according  to  the  model  used.  For  example, 
the  probability  of  customer  rejection  due  to  a  full  queue 
(PNMAX)  applies  only  to  finite  queue  systems  and  is  in¬ 
cluded  accordingly.  When  describing  Standard  M/M/ 1  and 
standard  M/M/C  systems,  it  is  possible  that  a  steady-state 
will  not  be  reached.  This  occurs  when  the  customer  arrival 
rate  exceeds  the  ability  of  the  service  system  to  handle 
the  arrivals.  Specifically,  this  happens  whenever 
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IAM13DA  C  x  MU 


(1) 


In  such  cases,  the  output  states  this  explicitly. 

After  the  output  listing,  the  user  may  elect  to  call 
for  optimization  of  KU  fur  a  single  server  system  or  opti¬ 
mization  of  server  number  (C)  for  a  multiple  server  system, 
as  discussed  in  Chapter  II.  The  specific  logic  of  this 
process  is  discussed  later  in  this  chapter. 

At  the  end  of  the  optimization  sequence,  the  user  may 
choose  to  run  another  problem.  If  he  does  not  so  choose, 
the  program  terminates. 

SubriU'ino  WHOM  i 

WRONG  is  called  by  MAIN  whenever  it  detects  an 
unacceptable  response  to  a  "yes"  or  "no"  question.  MAIN 
reads  only  the  first  character  in  the  response  to  such  a 
question.  If  the  first  character  is  anything  but  "Y"  (yes) 
or  "N"  (no),  then,  WRONG  is  called.  WRONG  transmits  an 
error  message  to  the  user  and  arks  for  a  corrected  response 
which  is  then  evaluated  for  acceptability.  If  the  corrected 
response  is  "Y"  or  "N",  it  is  returned  to  MAIN  and  the 
program  continues.  If  not,  the  error  sequence  is  repeated 
until  the  user  transmits  an  acceptable  response. 

Function  FACT(K) 

The  characteristic  equations  for  the  six  queueing 
models  use  factorial  computations  in  their  solution.  Where 


22 


appropriate,  the  model  subroutine:!  call  FAC'I'(K)  to  compute 
the  factorial  ol  a  given  integer,  Y/hcn  computing  the  fact¬ 
orial  of  K,  the  function  first  initializes  the  variable 
FACT  and  then  uses  a  DO  loop  to  iteratively  multiply  FACT 
by  successive  integers  from  1  to  K.  The  resul t  is  then  re¬ 
turned  to  the  calling  subprogram. 

Model  Subroutines 

The  six  model  subroutines  apply  the  equations  derived 
from  t  ho  queueing  theory.  They  are,  necessarily,  as  coir.pl  ex 
as  the  algebraic  computations  which  they  perform.  A 
comprehensive  understanding  of  these  subroutines  requires 
reference  to  the  flow  diagrams  in  Appendix  P  while  examin¬ 
ing  the  individual  FORTRAN  statements  one  by  one.  Input 
and  output  variables  are  transmitted  between  MAIN  and  the 
subroutines  by  the  use  of  both  arguments  to  the  subroutines 
and  COMMON  statements.  Variable  names  are  consistent 
throughout  the  entire  program.  Where  appropriate,  program 
variables  are  chosen  to  reflect  the  quantity  they  represent. 
For  instance,  NV.AX  is  the  maximum  number  of  units  allowed 
in  a  finite  queue  system.  The  subprograms  accurately 
reproduce  the  equations  presented  in  the  reference  text 
(Ref  6i44l,  471-474).  In  addition  to  MAIN,  the  subprogram 
OPTC  also  calls  the  M/M /C  models. 

Subprogram  0PTM7 

OPTMU  is  a  self  sufficient  subprogram.  It  requests 
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input  for  the  cost  of  waiting  (CWAIT)  and  the  marginal  cost 
of  service  (CSKRVE),  and  then  computes  and  prints  out  the 
optimally  cost  effective  value  of  MU  through  the  relation¬ 
ship 

i 

MU  =  LAMBDA  ♦  ( LAMBDA  x  CWAIT/CSEhVE)2  (2) 

(Kef  6s 460) 

where  CWAIT  is  defined  as  the  cost  per  customer  per  unit 
time  associated  with  having  a  customer  unit  in  the  service 
system  and  CSE1  VI  as  th(  marginal  cost  of  providing  service 
to  each  customer. 


Suip ro.-T.i~  01  TC 

OPTC  uses  CSEKVE  and  CWAIT  to  compute  the  most  cost 
effective  number  of  servers  for  a  multiple  server  system. 
It  uses  tne  following  expected  total  cost  per  unit  time 
function! 


ZEE  =  CSERVE  x  C  +  CWAIT  x  ELESS  (3) 

(Ref  6:461) 

where  KLIMS  is  the  steady-state  mean  number  o 1  units  in  the 
system.  It  should  be  noted  that  CSEKVE  here  is  redefined 
as  the  cost  of  providing  each  server  per  unit  time.  The 
subprogram  operates  in  an  iterative  fashion  where  CSEKVE 
and  CWAIT  remain  constant  and  ELESS  varies  with  iterative 
values  of  C.  The  process  works  in  the  foli owing  manner. 

C  is  assigned  the  value  of  2.  The  appropriate  model 
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subprogram  is  culled  to  determine  the  value  of  ELESS  cor¬ 


responding  to  C  =  2.  ZEE  is  then  computed.  C  is  then  set 
to  3*  ELESS  and  ZEE  are  again  computed.  11  ZEE  correspond¬ 
ing  to  C  =  2  is  less  than  or  equal  to  ZEE  corresponding  to 
C  =  3.  then  C  =  2  is  taken  as  the  optimal  value  (C  which 
results  in  minimum  cost).  If  not,  the  process  is  repeated 
for  C  -  4,  C  =  5,  etc.  until  a  ZEE  is  found  which  is 
greater  than  the  proceeding  ZEE.  The  optimal  number  of 
servers  is  the  next  to  last  C.  This  iterative  process 
quurantees  that  the  optimal  C  chosen  poduces  a  cost  (ZEE) 
less  than  the  cost  for  values  of  C  Loth  proceeding  and 
following  it.  The  optimal  C  and  its  associated  cost  are 
reported  to  the  user  and  program  control  is  returned  to 
MAIN.  Note  that  before  the  iterative  stops  are  initiated, 
valuer,  of  C  are  examined  ar.d  the  process  begins  with  the 
first  C  that  allows  the  system  to  reach  steady-state. 

Recall  that  arrival  rate  must  be  less  than  combined  service 
rate  for  the  Standard  M/K/C  model. 

Subrout i; ,o  DATA1 

DATA1  operates  on  raw  observation  data  concerning 
customer  arrivals  (for  finite  population  models,  see  DATA2 
below).  At  the  user's  discretion,  DATAl  accepts  the  number 
of  customer  arrivals  observed  during  any  number  of  equal 
observation  periods,  up  to  100  periods.  This  data  is  used 
to  compute  the  mean  arrival  rate  (LAMBDA) .  This  data  is 
compared  to  a  Poisson  probability  mass  function,  using 


23 


a  one  tail  chi-square  goodnesc-of-f it  test  with  a  .01 
level  of  significance.  Three  possible  outcomes  result 
from  the  test: 

1.  Acceptance  of  the  null  hypothesis  that  the  data 
fits  the  Poisson  distribution. 

2.  Rejection  of  the  null  hypothesis. 

3.  The  conclusion  that  an  insufficient  number  of 
observations  wore  made  for  the  test  to  be  valid. 

In  the  event  of  2  and  3  of  the  above,  the  user  has  the 
option  of  continuing  the  problem  based  on  the  computed 
LAMBDA.  If  sample  data  is  not  entered,  the  program  accepts 
a  value  of  LAMBDA  by  direct  input. 

Ui ibreut  i  i. » _ _I )ATA2 

DATA2  operates  on  raw  data  concerning  service  times. 

At  the  user's  descretion,  DATA2  accepts  the  time  needed  to 
service  up  to  100  customers.  A  mean  service  time  (MU)  is 
computed.  Service  time  data  is  compared  to  an  exponential 
probability  function  in  the  came  manner  as  the  customer 
arrival  data.  Possible  results  and  options  are  the  same 
as  in  the  DATA1  subroutine.  In  the  case  of  customer  arrivals 
from  a  finite  population,  the  interarrival  times  for  indi¬ 
vidual  customer  units  are  entered  and  tested  in  the  same 
method  as  service  times.  A  mean  .arrival  rate  per  customer 
is  calculated  for  use  in  the  FPMM1  and  FPMMC  subroutines. 

A  necessary  complement  to  the  program  described  in  this 
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chapter  is  a  set  of  instructions  for  using  the  program. 
Appendix  C  contains  a  copy  of  these  instructions.  The 
program  and  instructions  together  enable  users  to  apply 
the  models  to  problem  situations.  An  evaluation  of  the 
final  product  appears  in  the  following  chapter. 
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IV.  RESU1  TS  01  Ti . .  I 


The  cample  problems  located  in  Appendix  C  were  used  in 
tlu*  program  test.  A  review  of  thoce  problems  and  their 
accompanying  explanations  will  help  in  understanding 
pro t ions  of  the  following  analysis. 

■  •  -'t  Subjects 

Five  test  subjects  evaluated  the  program  described  in 
chapter  Ill.  These  subjects  reported  pertinent  background 
information  concerning  education,  vocation,  computer  ex¬ 
perience  and  knowledge  ol  queueing  theory  on  the  question¬ 
naire  located  in  Appendix  D.  This  information  is  summariz¬ 
’d  in  Table  III.  The  subjects  represent  a  wide  range  of 
vocational  and  educational  experience.  Computer  experience 
lor  subjects  A  and  E  is  limited  to  basic  programming 
arses.  Subjects  C  and  D  reported  extensive  computer 
/pericnce,  however,  this  experience  is  limited  to  data 
‘■'•rage  and  retrieval  systems.  Data  analysis  is  not  part 
their  job-  related  computer  experience.  Their  jobs  do 
quire  them  to  use  remote  terminals  similar  to  the  one 
'•d  for  the  test  sessions.  None  of  the  subjects  reported 
/  significant  knowledge  of  queueing  theory. 
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Individual  Task  Perl  orr.nn.-e 


Table  IV. summarizes  the  extent  of  difficulty  each 
subject  experienced  while  accompl i shine  individual  tasks 
during  the  test  sessions. 


TABLE  IV. 

Summary  of  Difficulties  Encountered 
During  1  rogram  Test 


Task 

None 

SI  ight 

Moderate 

Ex  trerce 

Con  triil  a/ 
Keyboard 

A.P.C.E. 

D 

LOGIN 

C.D.E 

A ,  B 

Program 

Access 

A ,  C ,  D ,  E 

B 

Data 

Input 

A.C 

B.D.E 

Mode  1 
Selection 

A.P.C.E 

D 

LOGOUT 

A, B.C.D.E 

Interpre¬ 
tation  of 

A.C.E 

B.D 

Kesul ts 

Printed 

Ins tru  •  t ions 

A 

B ,  C  ,  E 

D 

Control s/Kcyboard :  None  of  the  subjects  experienced  any 
significant  difficulties  operating  the  terminal  controls. 
Subject  D  could  not  locate  the  carriage  control  key  even 
though  it  is  clearly  marked  "RETURN"  and  its  orange  color 
contrasts  with  all  the  other  keys. 
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LOGIN  Procedure i  Problems  wit)i  this  task  were  minimal. 
Subject  A  did  not  place  comma:;  between  the  parameter:;. 
Subject  13  used  so  much  tint?  to  make  the  input  that  the  DATA 
PHONE  connection  was  automatically  terminated  lor  inactivity 
The  second  attempt:;  for  both  subject:’  were  successful. 

Program  Access :  Only  one  problem  ocurred  during  program 
access.  Subject  B  typed  the  commands  Incorrectly  twice* 

The  resulting  error  messages  generated  confusion. 

Data  Input:  Subjects  A  and  C  car*  fully  studied  each  request 
for  input.  Their  resj  >nsos  wore  correct,  although  they 
expressed  concern  over  being  unsure  about  the  definitions 
of  arrival  rate  and  service  rate  while  working  Problem  1. 

The  other  subjects  expressed  the  same  confusion  and  inj ut 
service  rate  data  in  place  of  arrival  data.  Their  second 
attempts  were  successful. 

Model  Selection:  Subjects  A.B.C,  and  h  used  the  program 
sequence  in  which  a  series  of  questions  leads  the  user  to 
the  corre<  t  model  •  These  four  subjects  f<  '.lowed  the  se¬ 
quence  correctly  for  both  problems.  For  Problem  1,  Gubjoct 
D  chose  *o  select  the  model  himself.  He  selected  a  finite 
queue  model  reasoning  that  if  there  wore  only  2‘j  drivers 
in  the  population,  then  the  queue  could  be  no  longer  than 
25.  For  Problem  2,  the  program  led  him  to  the  correct  model 

LOGOUT:  The  LOGOUT  procedure  presented  no  problems. 


Interpretation  of  Output;  Both  rumple  problems  ask  a  spe¬ 
cific  question.  In  each  case,  the  test  subjects  surmised 
the  correct  answer  based  on  the  output  they  received.  How¬ 
ever,  all  subjects  indicated  they  were  unsure  of  the  mean¬ 
ing  of  certain  printed  steady-state  characteristics.  The 
problem  is  discussed  further  in  the  following  section. 

Printed  Instructions;  Subjects  A,B,  and  C  found  that  the 
printed  instructions  were  adequate.  Subjects  1)  and  1.  com¬ 
mented  or.  the  survey  that  the  instructions  did  not  ade¬ 
quately  define  the  terms  used  in  the  program.  Two  obser¬ 
vations  are  worthy  of  note.  First,  subjects  D  and  E  spent 
the  least  amount  of  time  reading  the  instructions  before 
executing  the  program.  Second,  even  though  subjects  A,B, 
and  C  rated  the  instructions  favorably  on  the  survey ,  their 
verbal  comments  after  the  tort  sessions  indicated  that  they 
had  the  same  problems  with  definitions  as  reported  by  sub¬ 
jects  D  and  E. 

Ana  ly s i of  Hera .j  ts 

Overall,  operation  of  the  terminal,  to  include  access¬ 
ing  the  program,  was  satisfactory.  Some  mistakes  were  made 
initially,  but  the  subjects  mastered  the  basic  terminal 
operating  procedures  with  a  minimum  of  effort.  Those  that 
followed  the  instructions  carefully  and  deliberately  were 
successful  on  the  first  attempt.  Subject  D  provided  the 
contrast,  hash  actions  caused  him  to  make  several  mistakes. 
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For  the  other  subjects  the  step-by-step  process  of  gather¬ 
ing  inputs  successfully  led  the  subjects  through  the  oper¬ 
ation  of  the  program.  That  is  to  say,  the  subjects  were 
able  to  initiate  the  program  and  follow  it  through  to  a 
logical  conclusion.  Howevor,  not  all  subjects  arrived  at 
t  correct  solutions*  There  are  two  significant  reasons 
for  this. 

First  is  a  problem  of  definition.  The  printed  instruct¬ 
ion;’.  and  the  instructions  within  the  program  were  not  suf¬ 
ficiently  clear  to  guarantee  that  all  subjects  understood 
exactly  what  was  asked  of  them.  None  of  the  subjects  were 
absolutely  certain  that  they  understood  the  difference  be¬ 
tween  finite  queue  systems  and  finite  population  systems. 
Subject  D  arrived  at  an  incorrect  solution  to  Problem  1  due 
to  this  confusion. 

The  second  reason  involves  interpretation.  Errors  made 
on  Problem  2  provide  the  best  illustration.  Subject  B 
identified  the  system  as  having  four  servers  (the  lour  tele¬ 
phone  lines)  instead  of  one  server  (Joe).  Subject  E  failed 
to  convert  the  stated  fact  that  Joe  averaged  30  seconds  per 
customer  into  a  service  rate  of  2  customers  per  minute. 
Finally,  Subject  11  was  unable  to  recognise  the  lact  that 
one  phono  line  would  be  used  to  service  a  customer  thus 
limiting  the  maximum  length  of  the  finite  queue  to  three. 

Mis  input  was  a  maximum  queue  length  of  four. 

One  final  test  result  should  be  considered.  All  five 
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test  subjects  indicated  that,  they  felt  a  high  degree  of 
confidence  in  the  value  of  the  prognun  to  aid  decision- 
making.  On  a  scale  of  1  (least  confident)  to  ‘j  (most  confi 
dent)  ever}  subject  chose  a  conlid  arc  rating  of  h. 

Conclusions  drawn  Irora  these  test  results  are  reported 
in  the  next  chapter. 


Y .  SUMMARY.  CONCLUSIONS.  AND  RECOMMENDATIONS 


Sunn;  try 

Modern  management  theory  recognizes  the  need  for  quan¬ 
titative  decision-r.aking  in  routine  management  efforts. 
Limited  resources  often  preclude  managers  from  applying 
quantitative  techniques  to  their  routine  problem  solving 
situations.  They  do  not  po  V.  o  t '  «  *  I.’  the  requisite  technical 
knowledge  for  sophisticated  decision  analysis,  nor  do  they 
have  access  to  those  who  do.  Rapid  advances  in  computer 
technology  and  quantitative  problem  analysis  create  a  need 
for  developing  better  methods  of  application  at  the  prac¬ 
tical  level.  One  such  method  invloves  the  use  of  inter¬ 
active  computer  programming.  This  research  explores  the 
possibility  of  using  interactive  programming  to  satisfy 
this  need. 

An  interactive  program  war  written  to  integrate  complex 
queueing  the  ry  models  into  a  format  that  is  accessible  to 
non- technical ly  oriented  managers.  The  program  was  tested 
to  sec  if  the  following  objectives  wore  satisfied. 

1.  Proper  application  of  mathematical  theory. 

2.  The  user  need  not  have  an  extensive  knowledge  of 
computer  operations. 

3*  Program  inputs  and  outputs  have  a  meaningful  inter¬ 
pretation  for  the  non- technical  user. 

4.  The  user  feels  confident  that  the  rosul ts  are  valid. 


Analysis  ol'  the  test  results  lead  to  the  following  con¬ 


clusions. 

Cone  1  us  ions 

Three  major  conclusions  emerge  from  this  research. 

They  ares 

1.  Interactive  programs  cun  present  complex  analysis 
models  in  a  format  understood  by  a  non- technical 
user.  An  extensive  background  in  the  underlying 
mathematical  theory  1 rom  which  the  models  are  de¬ 
veloped  is  not  a  prerequisite  for  the  user  to  apply 
the  program  to  situational  problems. 

2.  The  manner  in  which  the  progmm  communicates  the 
model  concepts  and  sequential  instructions  to  the 
user  are  of  paramount  importance  in  developing  an 
analysis  sequence  that  is  meaningful  to  the 
decision-maker.  This  means  that  all  user-progrum 
interactions  must  be  consistent  with  the  user's 
experience.  Even  though  terms  and  concepts  that 
lire  new  to  the  user  are  well  defined  within  the 
program,  they  represent  possible  areas  of  confusion, 
and  therefore,  tend  to  limit  the  efficiency  with 
which  the  program  is  employed.  The  language  of 

the  program  should  be  the  language  of  the  user. 
Inputs,  outputs,  and  intervening  actions  must  be 
considered  in  this  context. 


3.  An  extensive  knowledge  of  computer  operations  is 

not  required  to  use  interactive  programs.  A 

decision-maker  can  be  involved  directly  with  the 

/ 

analysis  process. 

i 

Recommendations 

The  product  of  this  research  serves  only  to  indicate 
that  the  benefits  of  quantitative  analysis  can  be  made 
available  to  decision-makers  through  interactive  program¬ 
ming.  There  are  many  logical  extensions  of  this  concept. 
Stine  of  them  are  listed  below. 

1.  Survey  Air  Force  activities  to  classiiy  potential 
users.  Such  a  survey  might  identify  those  specific 
analytical  models  with  the  greatest  potential  for 
appl ication. 

2.  Identify  the  characteristics  of  an  interactive 
program  that  contribute  most  to  its  effective 
operation.  This  could  lead  to  the  development 
of  interactive  program  design  principles. 

3.  Develop  similar  programs  for  use  in  the  AFIT 
Systems  Management  curriculum.  Fxcrcises  in 
practical  application  could  be  generated  for 
courses  in  management,  economics  and  accounting. 

4.  Although  far  from  conclusive,  the  results  of  this 
research  suggest  that  direct  intcracti  in  with  the 
analysis  program  influences  the  amount  of  confi- 
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dunce*  a  user  displays  in  the  resulting  information. 
Design  and  conduct  a  research  experiment  to  deter¬ 
mine  the  extent  to  which  interaction  affects  that 
con  f idence . 
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APPENDIX  A 


PROG HAM 
VAR  I  API  E 

A 

ARRIV 

A  GUM 

D 

C 

CH12 

CHISQ 

CFR IMS 
CRHO 

C SERVE 

CSIZE 

CSUK 

CWAIT 


DEFINITION  P.  Q  F  V  A  R I A  B I  V.  5 


MODEL 

PARAMETER  DEFINITION 


LAMBDA 


MU 


C 


C‘ 


cs 


cw 


Mean  arrival  rate  (units 
per  time  period) 

A  100  element  array  con¬ 
taining  customer  arrival 
information 

Program  storage  eqv'al  to 
the  sum  of  ARRIV  elements 
(total  observed  arrivals) 

Mean  service  rate  (units 
per  time  period) 

Number  of  servers 

Program  storage  used  to 
accumulate  Die  chi-square 
test  statistic  for  sample 
data 

A  37  element  array  contain¬ 
ing  discrete  values  of  the 
chi-sq uaro  distribution 

Tost  per  server  per  unit 

Program  storage  equivalent 
to  RHO/C 

Marginal  cost  of  service 
per  customer 

Program  storage  vised  to 
compute  cell  size  for  the 
chi-square  test 

Progr;un  storage  used  to 
compute  iterative  totals 
of  CSIZE 

Cost  of  waiting  per  cus¬ 
tomer-unit  time 
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X 


DPZKKO 

- 

Program  storage 

KLRKE 

l.B 

Steady -state  mean  number 
of  -‘.nits  in  queue  for 
busy  system 

EI.EoS 

LS 

Steady-state  mean  number 
of  units  in  system 

ELQl’E 

LQ 

Steady -state  mean  number 
of  units  in  queue 

EVAL 

Program  storage'  used  to 
compute  the  expected  value 
of  customer  arrivals,  or 
service  time  based  on 
probability  functions 

FREQ 

“ 

A  IOC'  el«:iont  array  con¬ 
taining  the  frequency  of 
a  value  of  ARftlV  or  5T1M 

1 

- 

Internal  program  index 

INT 

- 

Internal  program  index 

J 

- 

Internal  program  index 

K 

- 

Internal  program  index 

L 

- 

Internal  program  index 

LEFT 

- 

Internal  program  index 

LIM1 

- 

Internal  program  ind^x 
defining  all  boundaries 

LI  M2 

- 

Internal  prognun  index 
defining  cell  boundaries 

LIKQ 

- 

Maximum  number  of  units 
allowed  in  a  finite  queue 

M 

M 

Number  of  units  in  a  finite 
population 

MSIGN 

- 

Program  storage  used  to 
define  model  codes 

mval 

- 

Trogram  storage  used  to 
define  model  codes 

^3 


Til 


Internal  program  index 
equal  to  the  number  of 
data  observations 


NCKLI. 

Internal  program  index 
equal  to  the  number  of 
cells  used  in  the  chi- 
square  test 

NDF 

“ 

Number  of  dcgn  cs-of- 
freedom  for  the  chi- 
square  test 

N.V.AX 

N 

Maximum  number  ol  units 
allowed  in  system  equal 
to  LIMQ  +  C 

nmc 

- 

Program  storage  equal  to 

KM AX  -  C 

OPTVAL 

(MU) 

Optima]  MU  lor  single 
server  systems 

pbuky 

Program  storage  equal  to 
pro! ability  that  the 
system  is  busy  (1  -  PZERO) 

PNG  EC 

Program  storage  ^qual  to 
the  probability  that  all 
servers  are  busy 

PNMAX 

P(N) 

Probability  of  rejection 
from  the  system  due  to  a 
full  queue  (1  ini  to  queue 
system:  ) 

POISS 

- 

Storage  for  discrete  Poisson 
distribution  values 

PROP 

- 

Probability  value 

PR0B1 

- 

Probability  value 

PR0B2 

- 

Probability  value 

PSUM 

- 

Internal  program  storage 
summing  probability  values. 

PZERO 


P(0) 


Probability  that  the 
system  is  idle 


st  in: 


TUf-:i 


TLIM2 

TSUI* 


Q 

RHO  RHO 


W 


X 

y 

7. 


A  100  element  array  con¬ 
taining  observed  service 
times 

Internal  program  index 
delining  cell  boundaries 

Internal  program  index 
defining  cell  boundaries 

Progriim  storage  equal  to 
the  sum  ol  S'i'lK  elements 
(total  observed  service 
time ) 

Program  storag” -answers 
to  yen/no  questions 

Traffic  intensity  equal 
to  LAMP, DA/MU 

Program  constant  equal 
to  0 


Program  constant  equal 
to  0.5 

Program  constant  equal 
to  1,0 

Program  constant  equal 
to  2.0 
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APPENDIX  B 


IDG  I C  DIAGRAMS  AND  PR'  )GKAI*  LISTING 

The  following  list  in  provided  for 
the  convenience  of  the  reader. 

Figure  Page 

3.  Program  MAIN . 47 

4.  Subroutine  STEM1 . 51 

5.  Subroutine  FQKM1  .  52 

6.  Subroutine  FPJO!l . 53 

7.  Subroutine  STKMC  .  54 

8.  Subroutine  FQKKC  .  56 

9*  Subroutine  FPMMC  .  58 

10.  Subroutine  WRONG  .  60 

11.  Subroutine  OPTMU  .  6l 

12.  Subroutine  FACT(K)  .  62 

13.  Subroutine  OPTC . 63 

14.  Subroutine  DATA1  .  67 

15.  Subroutine  PROBS  .  68 

16.  Subroutine  DATA2  .  69 

17.  Subroutine  PROBE  .  70 

Program  Listing  .  71 
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Figure  3-  I  To  gran.  MAIN  (cont.) 


Figure  3»  Program  MAIN  (cont.) 
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TKKI.'J-  1 


r  TLRK1 
TERV1+ 

I  PACT(I))  J 


J-  Ol 


J  a  C  - 1 


TEK  TKM.U 
+  (RHOv<*l/C 
**(I-C)) 


[pZERI  1/ 

I  ( TERF1  +  ( 1 

/fact(c)* 

TMK?.:^ )  ) 


FNKAX  RHC-** 
NKAX* PZERO/ 
FACT(C )/C** 
( NMAX-C ) 


DO  1  =  1  .  .1 


tkrf>  tekk; 

♦  ( KMO*  *  1/ 
FACT(I)) 


Figure  8.  Subroutine  FQNKC 
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Fif  iro  9«  Subroutine  Fl'K^C  (cont.  ) 
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(WRONG 


/ — 


Trin  t 
"WRONG 

an:;w  .  • 


1 1  r  i  n  t 

CORKRCT 


READ  £ 


Q  Y  or  N 

Nyr^| 


Figure  10.  ;‘\ibroutinr  WRONG 


FACT  1 


Figure  1 


_ 1 

’ 

DO  I 

-l.K 

\ 

f 

FACT- 

FACT*! 

1 

G  •TUHN 


Subroutine  FACT(K) 


Figure  13.  Sutijoutine  OFTC  (cont.) 
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Subroutine  01 TC  (cont.) 


Figure  13.  Subroutine  OTTC  <cont.) 


Kif.urr  14.  Subroutine  DATAl 
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QUEUEli _ AN_  I N1  j IRACT 1 VE  PROGRAM 


Program  Descr  i  r  t  i  on 

QUEUE1  in  a  computer  program  designed  to  aid  managers 
with  decision-making  efforts  concerning  waiting  lines 
(queues)  and  associated  service  systems.  QUEUE1  incorpo- 
rates  mathematical  models  which  describe  a  certain  class  of 
service  systems  characterized  by  the  following  assumptions i 

1.  Customer  arrivals  to  the  service  system  may  bo 
reasonably  described  by  the  Poisson  probability 
mass  function. 

2.  Customers  arc  "patient"  and  "well-behaved” j  that 
is,  they  will  enter  a  waiting  line  regardless  of 
its  length  and  will  not  leave  a  waiting  line  once 
they  have  entered  it. 

3.  Customers  waiting  in  line  are  served  on  a  "Xirrt- 
comc,  first-served"  basis. 

4.  All  servers  are  identical,  and  servico  times  may 
be  approx ir.a ted  by  the  exponential  probability 
density  function. 

If  it  is  uncertain  that  customer  arrival  and  service  time 
distributions  meet  these  assumptions,  CUbUEl  will  perform  a 
test  on  observations  to  check  for  compliance.  QUEUE1 
accepts  inputs  that  define  the  service  system  in  question 
and  generates  output  that  describes  the  steady-state 
operation  of  the  service  system.  Refer  to  the  examples 
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included  in  these  instructions  for  a  list  oi  these  char¬ 
acteristics.  For  single  server  systems,  QUEUE1  can  compute 
an  optimum  service  rate  which  will  result  in  the  lowest 
cost  of  operating  that  system.  For  multiple  server  systems, 
QUEl'El  will  compute  the  number  of  servers  which  results  in 
the  lowest  operating  cost.  The  models  and  equations  used 
in  QUEUL’l  and  discussed  in  these  instructions  may  be  ref¬ 
erenced  i n  Princ i t  al  s  i‘  Operations  h<  ■search  lor  Fans /.< -men t 
(Budnick,  Mojena,  and  Vollmam  Richard  D.  Irwin,  Inc.,  3977) • 


Dei  ini t ion s 

Understanding  the  following  definitions  will  help  in 
exccut i r.g  QV;  .  .1 . 

A  QUEUE  is  a  waiting  line.  It  is  mack  up  of  customers 
waiting  for  sene  type  of  service  to  be  performed  by  a 
server.  A  custom*  r  is  not  necessarily  a  person.  A  cus¬ 
tomer  is  any  unit  requiring  the  service  in  question.  A 
customer  may  be  a  letter  or.  a  conveyor  belt  waiting  to  be 
processed .  The  size  of  the  queue  does  not  include  those 
customers  already  being  serviced. 

The  ARRIVAL  RATE  is  a  measure  of  the  frequency  with  which 
customers  arrive  at  the  service  system.  Arrival  rates  are 
expri  esi  i  in  mat  er  oi  t<  mere  per  tine  period,  in 
general,  th».  arrival  rate  refers  to  hew  many  customers  ar- 
riv<  luri  tint  peri<  ...  However,  in  finite  population 

problems,  the  arrival  rate  refers  to  how  often  an  indi¬ 
vidual  :  eat  r  <  !  th<  .  pulation  arrives  during  a  time  period. 

The  SERVICE  RATE  is  a  measure  of  the  speed  which  a  server 
can  process  customers.  In  QUKUE1  the  service  rate  mu;-. t 
be  expres  ed  in  the  same  units  as  the  arrival  rate,  cus¬ 
tomer  units  that  can  be  serviced  per  time  period. 

A  FINITE  QUEUE  SYSTEM  is  one  in  which  the  length  of  the 
queue  is  limited  to  a  certain  length .  When  the  queue  is 
full,  additional  customers  who  arrive  are  not  allowed  to 
enter  the  queue.  They  are  said  to  be  rejected.  The  queue 
for  a  drive-in  banking  facility  might  be  limited  if  the 

l 
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off  afreet  waiting  apace  only  had  room  ior  a  small  number 
of  car:;.  Population  size  doe;;  n<> t  eonstituto  a  queue  limit 

A  FINITE  POPULATION  SYSTEM  in  one  in  which  the  number  o 1 
customers  that  may  need  service  i:;  .limited  to  a  certain 
number.  For  example,  oil  ice  workers  using  the  same  copy¬ 
ing  machine  represent  a  finite  population.  Populations  of 
30  or  more  can  usually  be  considered  infinite. 

Pro pa rat  5  n 

Before  initiating  QUEUE!,  gather  the  following  infor¬ 
mation: 


1.  Number  of  servers  in  the  system. 

2.  Naxii  n  :  a  ber  1  1  oust  mere  allowed  in  the  queue 

at  any  one  time  (if  applicable). 

.  Thi  si  si  (  the  oust  mer  population  that  might  be 

using  th<-  queue  (normally,  a  j  pul  at  ion  size  ol 
30  or  more  is  considered  infinite). 

4.  The  a r fin  at  <  1  service  per  customer ,  if  the 

optimal  service  rate  is  tc  be  computed  (optional 
and  af.pl:  s  to  single  server  systems  only). 

5.  The  cost  per  server  per  unit  tire-,  if  the  optimal 
number  of  servers  is  to  be  computed. 

6.  The  cost  of  having  a  customer  wait  per  unit  time, 

for  1  ither  oi  thi  two  optii  L  eat  ion  cases. 

7.  Raw  obsorv.  tion  data.  Example  1  chows  the  kind  of 
raw  obsorv.  tien  data  that  may  be  entered  and  the 
■eth<  d  1  entry.  Mi  n  s<  rv  i  :e  rati  s  and  mean 
arrival  rates  (averages)  may  be  entered  instead  of 
observati  n  data.  This  ic  shew:,  in  example  2. 

Care  should  be  taken  to  insure  that  all  inputs  agree  in 

unit  dimensions.  That  ic,  if  a  service  rate  is  expressed 

in  unite  per  hour,  then  arrival  rates  must  be  expressed  in 

units  per  hour  (not  units  per  second  or  minute). 


Rc~  ote  term  inn]  Opera  t  i  or. 


QUEUK1  requires  the  active  par ticipation  of  Uio  user. 
The  following  rot  of  instructions  will  onablo  the  user  to 
access  QUEUK1  on  a  remote  terminal  in  the  AHIT  computer 
lacilities.  These  instructions  are  not  intended  to  address 
all  operating  procedures  for  the  APIT  remote  terminals* 

They  are  adequate  only  to  direct  the  use  of  QUKUill .  A  more 
detailed  explanati  n  can  be  found  in  the  current  edition 
of  tl  ;  loaou u _•  jCentei  :om  Quid  (Roi  u ) .  Th< 

following  instructions  are  a da]  ed  fr  i  that  pul  Li  nation. 

TVrr  ir.a  1  !'  . : ■ 

Different  tyj  ol  terminals  ai  «  used  at  APIT.  It  may 
be  neoes<  try  U  lify  thi  fol  owinj  steps  slightly ,  de- 
ponding  uj  .  n  the  control/keyl  urd  configuration  of  the 
specific  terminal  being  used. 

1.  Check  to  see  that  the  terminal  is  plugged  in. 

2.  i!  tl,"  DATA  I  s  the  removable  type,  check  to 

see  il  it  is  plugged  in. 

3*  Check  the  contr<  li  on  the  front  panel  and  under 

th<  top  cover.  The  settings  should  be 


Tower  ON 

On  Line  ON 

Speed  HIGH 

Duplex  HALF 

Lino  Feed  1 


4.  Push  the  TA1X/CLEAR  button  on  the  DATA  PHONE. 

5*  Dial  the  ppropriate  300  BAID  number  (currently 
.5180  or  3139). 

6.  When  you  hear  the  high  pitched  tone  through  the 
receiver,  depress  the  DATA  button  on  the  DATA 
PHONE  and  replace  the  receiver. 
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7. 


Press  the  carriage  return  key  on  the  terminal  key¬ 
board  (marked  CARRIAGE  or  CK). 

8.  You  will  receive  a  message  on  the  printer.  The 
last  line  wi ! !  be  "PLEASE  LOGIN".  If  you  do  not 
receive  this  message,  then  the  computer  is  down 
or  there  is  a  problem  wi th  tne  terminal. 

IOG IN  l  rocedure 

The  LOGIN  command  has  the  following  format 
1X)G  I N ,  xnnr.nnn ,  xxxxxxxxxx  ,  TID 
The  paramters  are  positional  arid  required.  The  first 
parameter  is  the  user’s  problem  number.  The  second  param¬ 
eter  is  the  us.r's  assigned  INTERCOM  password.  It  may  be 
up  to  ten  positions  in  length  and  nay  contain  any  combi¬ 
nation  of  letters  or  digit.-.  The  problem  mar; her  arid  pass¬ 
word  may  be  assigned  by  your  course  instructor  or  the  AK1T 
computer  center.  The  third  jaraseter  is  the  three  position 
t-minal  identifier.  The  TID  appears  on  a  label  on  the 
terminal.  A  typical  LOGIN  command  is  shown  in  the  examples. 

N  •  e  that  .  nu8l  separate  sach  parameter.  Once  typed, 

the  command  is  transmitted  by  pressing  the  carriage  return 
key.  If  you  r  *ke  an  error  on  the  first  attempt,  INTERCOM 
will  ask  for  each  parameter  in  turn.  If,  after  three 
attempts,  you  are  still  unsuccessful,  INTERCOM  will  display 
a  message  asking  you  to  get  help.  Before  you  attempt  another 
LOGIN,  you  must  go  back  to  step  4  of  the  terminal  hookup 
procedure.  Once  th«  LOGIN  procedure  is  complete,  the 
computer  will  signal  that  it  is  ready  for  further  interaction 


- 
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by  printing: 


CO MM AND - 


Exocutir r_the_  Pro r.r.im 

The  following  commands  will  access  Ql'EUEl  and  begin 
its  operation.  Input  each  command  in  turn,  exactly  as 
written  here  and  as  is  shown  in  the  examples.  After  each 
individual  command  is  transmitted  with  the  carriage  return 
key,  wait  for  the  "COMMAND-"  rospor.ee  before  entering  the 
next  command. 

ATTACH,  QUKU:  1 
RKWlND.Qi'M  1 
FTN,  I  -QD:-  .  l.L-0 
LGO 

From  t >. i :*  point  on  QUIv'Rl  wi  .  I  provide  you  with  instructions. 
If  the  computer  system  is  busy,  there  will  be  a  short  delay 
of  as  much  as  a  minute  for  the  computer  to  respond  to  in¬ 
puts.  The  following,  exjtr.pl er  demonstrate  successful 
INTERCOM  sessions  with  QUKUE1 . 

LOGQU ;  I v. :oj ■  jure 

When  the  program  finishes,  INTERCOM  will  revert  to  the 
COWHAND  mode,  signified  by  the  computer  generated  "COMMAND- ” 
printout.  To  terminate  the  session  simply  transmit  the 
message 

LOGOUT 

After  the  computer  prints  its  response  to  this  command, 
push  the  TALK/CLEAR  button  on  the  DATA  PHONE. 


pkobu:::  ei 


You  own  a  business  that  distributes  wholesale  merchan 
d i se  throughout  the  state.  You  employ  2‘j  drivers  who  de¬ 
liver  this  merchandise  from  your  warehouse  to  various 
retail  stores.  The  drivers  receive  their  loads  and  bills 
of  lading  fr  workers  at  the  loading  docks.  You  have  em 
ployed  4  such  workers..  You  wonder  il  you  should  lire  one 
ol  these  workers  since  there  does:  not  seem  to  be  enough 
work  to  keep  then  busy  n  si  of  the  tine •  Each  driver  is 
paid  $6.00  p«r  hour.  Each  warehouse  employee  is  paid  $3 • 
p»  r  hour.  The  following  table  shows  how  long  it.  took  to 
load  5 0  Cejar.itt?  trucks. 


‘ruck 

Load i ng 

Truck 

Load 

lumber 

Time  (1  urs) 

Nujr.bc  r 

Time  ( 

1 

.  1 

26 

.T* 

2 

•  3 

27 

.  1 

7 

S 

.  5 

28 

.  1 

4 

.  1 

29 

.  1 

5 

.  s 

30 

1.0 

6 

.4 

31 

.7 

7 

.2 

32 

.2 

8 

.3 

33 

.9 

9 

.7 

34 

.2 

10 

.6 

35 

.  1 

11 

.2 

36 

•  3 

12 

•  5 

37 

1.2 

13 

.4 

38 

•  5 

14 

.  1 

39 

•  5 

15 

1.1 

40 

•  3 

16 

•  2 

41 

.  1 

17 

.8 

42 

.  1 

18 

.3 

43 

.2 

19 

.  1 

44 

•  3 

20 

.6 

45 

.4 

21 

.4 

46 

.3 

22 

.6 

47 

.9 

23 

.2 

48 

.1 

24 

.8 

49 

.7 

25 

.  1 

50 

•  3 

Also,  you  kept  track  of  the  tine*  it  took  for  your  trucks 


to  return,  once 

they  had  left 

the  warehouse  to  make 

a  de 

livery.  Fifty 

of  those  times 

are  listed  below. 

Observa t i or 

Observation 

Number' 

Tine 

Number 

Time 

1 

.9 

26 

T.4 

2 

5-1 

27 

9.0 

3 

1.2 

28 

1.3 

4 

7.9 

29 

4.1 

5 

2.9 

30 

7-7 

6 

4.4 

31 

•5 

7 

2.9 

32 

5.0 

8 

6. 1 

33 

2.6 

9 

.9 

34 

7.8 

lo 

9.0 

35 

1 .4 

11 

5-0 

36 

3-9 

12 

1.7 

37 

10.8 

13 

4.7 

38 

.4 

14 

11.4 

39 

5-8 

13 

1.5 

40 

3.0 

16 

8.9 

41 

8.0 

17 

2.6 

42 

1 . 1 

18 

3.0 

lO 

4.9 

19 

1.7 

44 

5.0 

20 

.8 

45 

1.0 

21 

10.8 

46 

9.9 

22 

7.9 

47 

3.8 

23 

1.0 

48 

1.6 

24 

2.8 

49 

5-8 

25 

3.4 

50 

3.2 

What  should  you  do? 


In  this  problem.  there  are  4  server::  and  tho  customer 
population  has  a  finite  size  of  2jj.  Thus,  the  model  used 
is  tho  Finite  Population  K/V./C  model  with  C  equal  to  4. 

The  following  printout  represents  the  QUEUE 1  solution  to 
this  problem.  These  explanations  will  help  to  define  the 
output. 

LAMBDA-  Each  driver  returns,  on  the  average,  .23  times  per 
hourj  or  the  average  round  trip  takes  4.4l  hours. 
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LAMBDA1-5*16  drivers  arrive  fur  service  every  hour. 

!«'.U-  On  the  average,  each  server  can  take  care  of  2.48 
loads  every  hour. 

RHO-  LAMBDA/MU 

T(0)-  11>  of  the  time  there  are  not  trucks  being  loaded 

at  the  warehouse. 

1,S-  At  any  given  tine,  one  could  expect  to  see  2.21 

trucks  either  being  loaded  or  waiting  to  be  loaded. 

LQ-  At  any  given  time,  .14  trucks  will  be  waiting  in 
line.  Practically  spe. iking,  there  is  little  or 
no  waiting  for  service. 

LB-  Given  that  at  least  one  loader  (server)  is  already 
bury,  .3k  trucks  could  be  expected  to  be  waiting 
in  line. 

KS-  On  the  average,  a  driver  can  expect  to  spend  .43 
hours  from  the  tine  he  arrives  till  he  has  been 
loaded  and  is  ready  to  go  ag.iin. 

WQ-  On  the  average,  each  driver  can  expect  to  spend 
.03  hours  waiting  to  be  loaded. 

WB-  If  a  driver  knows  that  at  least  one  truck  is 

already  being  loaded ,  he  can  expect  to  wait  .06 
hours  in  the  waiting  line  before  being  loaded. 

CW-  It  cost  the  company  $'.00  per  hour  to  have  drivers 

in  the  loading  system  instead  ol  out  on  the  roud 
driving. 

CS-  Each  loader  (server)  costs  the  company  $3*75  per 
hour  wheth-T  or  not  there  is  work  for  him  to  do. 

C-  Here,  C  =  3  is  the  most  cost  effective  number  of 

servers  to  employ  for  the  loading  operation. 

Z-  With  3  servers  the  average  cost  per  hour  for  pay¬ 

ing  loaders  and  waiting  drivers  is  $27.31 


Z  =  C  x  CS  ♦  LS  x  CW 


The  conclusion  reached  is  to  fire  one  loader.  A  description 


104 


of  the  service  system  with  only  throe  servers  can  be 
generated  by  running  QUKUK1  again • 
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rROBU-M  ^2 


Your  local  bookmaker,  Joe,  deals  strictly  on  a  phono- 
in  basis.  Ho  runs  one  phono  on  a  4  lino  rotary  system. 

This  moans  that  ho  can  tako  a  bet  on  one  line  and  up  to 
three  more  betters  can  call  his  number  and  wait  for  him  to 
answer.  It  all  four  lines  are  busy,  the  fifth  caller  will 
Get  a  busy  signal'.  On  the  average,  throe  betters  try  to 
call  Joe  every  minute.  Joe  boasts  that  he  averages  3° 
second:  per  bet.  Whenever  you  call  Joe  what  is  thi  proba¬ 
bility  that  you  will  get  a  busy  signal'.’  What  assumptions 
have  you  made? 

In  this  problem  sample  data  for  arrival  rate  and  service 
rate  are  n  t  available.  It  must  be  assumed  that  the  proba¬ 
bility  distributions  meet  the  model  assumptions.  There  is 
only  one  server,  Joe.  The  number  of  customers  who  can 
enter  the  system  is  limited  to  four  since  there  are  only  four 
telephone  lines  that  reach  Joe.  If  he  is  taking  a  bet  from 
a  customer  on  one  of  these  lines  (Joe  is  servicing  a  cus- 
l  er)  then  the  maximum  length  of  the  waiting  line  is  three. 
The  mean  arrival  rate  is  three  customers  per  minute.  If 
Joe  can  handle  1  bet  every  30  seconds,  his  mean  service 
rate  is  2  per  minute.  The  system  then  is  a  Finite  Queue 
K/K/1  type  with  IJiMBDA  equal  to  3  and  MU  equal  to  2.  In 
this  case  you  are  rejected  from  the  waiting  line  if  you 
dial  Joe’s  number  and  got  a  busy  signal.  P(N)  equals  .3838, 
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no  on  the  average  you  will  get  a  busy  cigna]  'jBfi  ol  the 
time. 
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The  following  information  will  be  used  to  evaluate  the 
effectiveness  ol  QUEUE1  and  the  instructions  you  were  given. 
Please  make  any  comment:;,  positive  or  negative,  you  feel 
would  aid  this  evaluation. 

1.  What  is  your  profession? 


?.  What  is  your  highest  level  of  education? 

* 

3.  List  any  degrees  you  have  earned. 


4.  What  is  the  extent  of  your  knowledge  of  queueing  theory? 


5.  List  your  level  of  experience  with  computers. 

6.  How  familiar  are  you  with  remote  computer  terminals? 

7.  List  any  problems  you  had  with  the  fo.l  .1  owi ng: 

a.  terminal  controls/keyboard. 

b.  LOGIN  procedure. 

c.  accessing  QUEUE 1 . 

d.  data  input. 

e.  selecting  the  correct  model. 


f.  LOGOUT  procedure. 


g.  interpreting  the  results  of  the  exercise. 


.  Comment  on  the  printed  instructions! 

a.  length. 

b.  detail. 

c.  clarity. 

d.  accuracy. 


.  Indicate  how  confident  you  are  that  QUKUK1  can  aid 
decision-making  in  real  situations. 

12  3  ^5 

least  most 

confident  confident 


.  Additional  comments. 
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